Lời giải:

Áp dụng BĐT AM-GM:

\(P=\frac{2a}{\sqrt{a^2+ab+bc+ac}}+\frac{b}{\sqrt{b^2+ab+bc+ac}}+\frac{c}{\sqrt{c^2+ab+bc+ac}}\\ =\frac{2a}{\sqrt{(a+b)(a+c)}}+\frac{b}{\sqrt{(b+c)(b+a)}}+\frac{c}{\sqrt{(c+a)(c+b)}}\)

\(\leq \frac{a}{a+b}+\frac{a}{a+c}+\frac{b}{4(b+c)}+\frac{b}{b+a}+\frac{c}{4(c+b)}+\frac{c}{c+a}\)

\(=(\frac{a}{a+b}+\frac{b}{b+a})+(\frac{a}{a+c}+\frac{c}{a+c})+\frac{1}{4}(\frac{b}{b+c}+\frac{c}{b+c})=1+1+\frac{1}{4}=\frac{9}{4}\)

Vậy $P_{\max}=\frac{9}{4}$

\(Q=\dfrac{2a}{\sqrt{a^2+ab+bc+ca}}+\dfrac{b}{\sqrt{b^2+ab+bc+ca}}+\dfrac{c}{\sqrt{c^2+ab+bc+ca}}\)

\(=\dfrac{2a}{\sqrt{\left(a+b\right)\left(a+c\right)}}+\dfrac{b}{\sqrt{\left(a+b\right)\left(b+c\right)}}+\dfrac{c}{\sqrt{\left(a+c\right)\left(b+c\right)}}\)

\(=\sqrt{\dfrac{2a}{a+b}.\dfrac{2a}{a+c}}+\sqrt{\dfrac{2b}{a+b}.\dfrac{b}{2\left(b+c\right)}}+\sqrt{\dfrac{2c}{a+c}.\dfrac{c}{2\left(b+c\right)}}\)

\(\le\dfrac{1}{2}\left(\dfrac{2a}{a+b}+\dfrac{2a}{a+c}+\dfrac{2b}{a+b}+\dfrac{b}{2\left(b+c\right)}+\dfrac{2c}{a+c}+\dfrac{c}{2\left(b+c\right)}\right)\)

\(=\dfrac{9}{4}\)

Dấu "=" xảy ra khi \(\left(a;b;c\right)=\left(\dfrac{7}{\sqrt{15}};\dfrac{1}{\sqrt{15}};\dfrac{1}{\sqrt{15}}\right)\)

\(a^2-ab+b^2=\dfrac{1}{4}\left(a+b\right)^2+\dfrac{3}{4}\left(a-b\right)^2\ge\dfrac{1}{4}\left(a+b\right)^2\)

\(\Rightarrow P\le\dfrac{2}{a+b}+\dfrac{2}{b+c}+\dfrac{2}{c+a}\le\dfrac{1}{a}+\dfrac{1}{b}+\dfrac{1}{c}=3\)

Dấu "=" xảy ra khi \(a=b=c=1\)

\(\dfrac{ab}{\sqrt{ab+2c}}=\dfrac{ab}{\sqrt{ab+\left(a+b+c\right)c}}=\dfrac{ab}{\sqrt{\left(a+c\right)\left(b+c\right)}}=ab\cdot\sqrt{\dfrac{1}{a+b}\cdot\dfrac{1}{b+c}}\le ab\cdot\dfrac{1}{2}\left(\dfrac{1}{a+b}+\dfrac{1}{b+c}\right)=\dfrac{1}{2}\left(\dfrac{ab}{a+b}+\dfrac{ab}{b+c}\right)\)

CMTT: \(\dfrac{bc}{\sqrt{bc+2a}}\le\dfrac{1}{2}\left(\dfrac{bc}{a+b}+\dfrac{bc}{a+c}\right);\dfrac{ac}{\sqrt{ac+2b}}\le\dfrac{1}{2}\left(\dfrac{ac}{b+c}+\dfrac{ac}{b+a}\right)\)

\(\Leftrightarrow P\le\dfrac{1}{2}\left(\dfrac{ab}{c+a}+\dfrac{ab}{c+b}+\dfrac{bc}{b+a}+\dfrac{bc}{c+a}+\dfrac{ac}{b+c}+\dfrac{ac}{b+c}\right)\\ \Leftrightarrow P\le\dfrac{1}{2}\left[\dfrac{b\left(a+c\right)}{a+c}+\dfrac{a\left(b+c\right)}{b+c}+\dfrac{c\left(a+b\right)}{a+b}\right]=\dfrac{1}{2}\left(a+b+c\right)=1\)

Dấu \("="\Leftrightarrow a=b=c=\dfrac{2}{3}\)

\(\dfrac{ab}{\sqrt{ab+2c}}=\dfrac{ab}{\sqrt{ab+c\left(a+b+c\right)}}=\dfrac{ab}{\sqrt{\left(a+c\right)\left(b+c\right)}}\le\dfrac{1}{2}\left(\dfrac{ab}{a+c}+\dfrac{ab}{b+c}\right)\)

Tương tự:

\(\dfrac{bc}{\sqrt{bc+2a}}\le\dfrac{1}{2}\left(\dfrac{bc}{a+b}+\dfrac{bc}{a+c}\right)\) ; \(\dfrac{ca}{\sqrt{ac+2b}}\le\dfrac{1}{2}\left(\dfrac{ca}{a+b}+\dfrac{ca}{b+c}\right)\)

Cộng vế:

\(P\le\dfrac{1}{2}\left(\dfrac{bc}{a+b}+\dfrac{ca}{a+b}+\dfrac{ab}{a+c}+\dfrac{bc}{a+c}+\dfrac{ab}{b+c}+\dfrac{ca}{b+c}\right)=\dfrac{1}{2}\left(a+b+c\right)=1\)

\(P_{max}=1\) khi \(a=b=c=\dfrac{2}{3}\)

Đặt \(\left(\sqrt{a};\sqrt{b};\sqrt{c}\right)=\left(x;y;z\right)\Rightarrow x+y+z=1\)

BĐT trở thành: \(\dfrac{xy}{\sqrt{x^2+y^2+2z^2}}+\dfrac{yz}{\sqrt{y^2+z^2+2x^2}}+\dfrac{zx}{\sqrt{x^2+z^2+2y^2}}\le\dfrac{1}{2}\)

Ta có:

\(x^2+z^2+y^2+z^2\ge\dfrac{1}{2}\left(x+z\right)^2+\dfrac{1}{2}\left(y+z\right)^2\ge\left(x+z\right)\left(y+z\right)\)

\(\Rightarrow\dfrac{xy}{\sqrt{x^2+y^2+2z^2}}\le\dfrac{xy}{\sqrt{\left(x+z\right)\left(y+z\right)}}\le\dfrac{1}{2}\left(\dfrac{xy}{x+z}+\dfrac{xy}{y+z}\right)\)

Tương tự: \(\dfrac{yz}{\sqrt{y^2+z^2+2x^2}}\le\dfrac{1}{2}\left(\dfrac{yz}{x+y}+\dfrac{yz}{x+z}\right)\)

\(\dfrac{zx}{\sqrt{z^2+x^2+2y^2}}\le\dfrac{1}{2}\left(\dfrac{zx}{x+y}+\dfrac{zx}{y+z}\right)\)

Cộng vế với vế:

\(VT\le\dfrac{1}{2}\left(\dfrac{zx+yz}{x+y}+\dfrac{xy+zx}{y+z}+\dfrac{yz+xy}{z+x}\right)=\dfrac{1}{2}\left(x+y+z\right)=\dfrac{1}{2}\) (đpcm)

Dấu "=" xảy ra khi \(x=y=z\) hay \(a=b=c\)

\(\dfrac{\sqrt{ab+2c^2}}{\sqrt{1+ab-c^2}}=\dfrac{\sqrt{ab+2c^2}}{\sqrt{a^2+b^2+ab}}=\dfrac{ab+2c^2}{\sqrt{\left(a^2+b^2+ab\right)\left(ab+2c^2\right)}}\ge\dfrac{2\left(ab+2c^2\right)}{a^2+b^2+2ab+2c^2}\)

\(\ge\dfrac{2\left(ab+2c^2\right)}{a^2+b^2+a^2+b^2+2c^2}=\dfrac{ab+2c^2}{a^2+b^2+c^2}=ab+2c^2\)

Tương tự và cộng lại:

\(VT\ge ab+bc+ca+2\left(a^2+b^2+c^2\right)=2+ab+bc+ca\)

\(\sqrt{\dfrac{ab+2c^2}{1+ab-c^2}}=\sqrt{\dfrac{ab+2c^2}{a^2+b^2+ab}}\)\(=\dfrac{ab+2c^2}{\sqrt{\left(a^2+b^2+ab\right)\left(ab+c^2+c^2\right)}}\)\(\ge\dfrac{2\left(ab+2c^2\right)}{a^2+b^2+2ab+2c^2}\)\(\ge\dfrac{2\left(ab+2c^2\right)}{2\left(a^2+b^2\right)+2c^2}\)\(=\dfrac{ab+2c^2}{a^2+b^2+c^2}\)

\(\Rightarrow\sqrt{\dfrac{ab+2c^2}{1+ab-c^2}}\ge ab+2c^2\)

Tương tự: \(\sqrt{\dfrac{bc+2a^2}{1+bc-a^2}}\ge bc+2a^2\); \(\sqrt{\dfrac{ac+2b^2}{1+ac-b^2}}\ge ac+2b^2\)

Cộng vế với vế \(\Rightarrow VT\ge2a^2+2b^2+2c^2+ab+bc+ac=2+ab+bc+ac\)

Dấu = xảy ra khi \(a=b=c=\dfrac{1}{\sqrt{3}}\)

Lời giải:

Áp dụng BĐT AM-GM:
\(P=\sum \sqrt{\frac{ab}{c+ab}}=\sum \sqrt{\frac{ab}{c(a+b+c)+ab}}=\sum \sqrt{\frac{ab}{(c+a)(c+b)}}\)

\(\leq \sum \frac{1}{2}\left(\frac{a}{c+a}+\frac{b}{c+b}\right)=\frac{1}{2}\left(\frac{a+b}{a+b}+\frac{b+c}{b+c}+\frac{c+a}{c+a}\right)=\frac{3}{2}\)

Vậy $P_{\max}=\frac{3}{2}$ khi $a=b=c=\frac{1}{3}$